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Voice control and uploadable user control information 
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BACKGROUND OF THE INVENTION 

The invention relates to a method for operating a multi-device consumer 
electronics system as claimed in the preamble of Claim 1. Consumer electronics systems, 
although internally attaining a sophistication that until recently was reserved for professional 
5 systems like mainframe-based systems, industrial and medical automation systems, scientific 
computing and the like, must however present to a user person an interface that is both 
transparent and straightforward, A particular facility of such systems is voice control for 
devices such as video recorders, audio and TV sets, CD and DVD players, and the like. 
Various further types of applicable consumer electronic devices are those that can be used by 
10 inexperienced members of the general public and in non-professional environments such as 
domotics and security. Such devices could then encompass home environment control, 
kitchen and washroom appliances, cameras, and portable telephone devices. Now, inasmuch 
as the respective devices would need various idiosyncratic commands, in principle each 
thereof would need its own speech recognition facility. For cost saving, the speech 
15 recognition facility may be mapped on a particular master device among the various devices. 
Such measure however requires that the master would know all commands, etcetera, that 
should be recognized. Inasmuch as such commands would apply to all possible kinds of slave 
devices, such requirement would thus lead to a great degree of inflexibility. On the other 
hand, specific user programming of the master device is out of the question in view of the 
20 intended simplicity thereof. Note also that many systems don't have all of the possible kinds 
of slave devices, that new kinds or versions of slave devices may be designed afterwards, and 
that certain kinds of slave devices may occur in duplicate, such as audio tapes. Furthermore, 
slave devices may come from different manufacturers that could each specify their own 
recognition protocol; these should be usable as well. Note that the diminishing of the number 
i 25 of utterances that must be recognized, such as in a system with only relatively few slave 

I devices, may improve the reliability of the overall speech recognition. 
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In consequence, amongst other things, it is an object of the present invention 
to ensure a high degree of flexibility in providing a speech recognition facility in the master 
device without the need for user programming thereof. 

Now therefore, according to one of its aspects the invention is characterized 
5 * according to the characterizing part of Claim 1, The loading of the speech recognition 

information into the master device is quite straightforward, and may be effected on various 
levels of sophistication, depending on the actual facilities offered by the master, and/or the 
functionality level intended for the system as a whole. 

By itself, an information system with a speech interface has been described in 
10 US Patent 5,774,859, such indicating the applicable level of skill in speech recognition per 
se. The present invention however, provides a facility for dynamically loading into a master 
12 device of the speech recognition information that by itself pertains to speech recognition on 

^Sf behalf of a slave device. 

£ The invention also relates to a multi-device system arranged for implementing 

Zl 15 the method as claimed in Claim 4, and to a master device and to a slave device arranged for 
y use in such system. Further advantageous aspects of the invention are recited in dependent 

Claims. The speech recognition in the master device need not know beforehand the 
m commands applicable to the slaves, inasmuch as speech recognition proper need not know the 

m content of the speech, but only the association of a voice specification or "fingerprint" to a 

CI 20 particular representation thereof. In consequence, the wording of a conmiand, the language 
of the conmiand, the gender of the speaker, and various other types of variations may be 
programmed in the master through initializing such by the slave device in question. Then, the 
recognizing may use a description of the speech signal to be recognized. 



25 BRIEF DESCRIPTION OF THE DRAWING 

These and further aspects and advantages of the invention will be discussed 
more in detail hereinafter with reference to the disclosure of preferred embodiments, and in 
particular with reference to the appended Figures that show: 

Figure 1, a consumer electronics system provided with first and second 

30 devices; 

Figure 2, an operational flow chart of the loading and operating phases of the 

system. 
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Figure 1 illustrates a consumer electronics system provided with a first or 
master device 20 and a second or slave device 30. Multiple slave devices may be present. The 
first device may without implied or express limitation be a television set. The second device 
may without implied or express Umitation be a video recorder. Device 20 has a user 
functionality 28 that may tune to broadcast TV signals or switch to a particular cable TV 
program faciUty, and display program items and other items on a television screen not shown 
in detail for brevity. Likewise, device 20 may present such items on line 42 for storage in 
video recorder 30. The operation of device 20 is governed by a central digital controller 24. 
The digital controller 24 is connected to speech recognition controller 22 that can receive and 
recognize user coromands and other utterances in speech and, as the case may be, may also 
output speech utterances to a user, such as questions, commands, or countersignalizations 
regarding earlier speech recognitions, or possibly, non-recognitions. Next to the speech 
channel, further control interaction may be executed through the screen, by text, hotspots, 
and the Uke, or by mechanical interaction such as keyboard and/or mouse. 

The digital controller 24 controls the overall operation of device 20, in 
particular its prime facility 28, but the description thereof has been foregone here, inasmuch 
as such may be largely conventional. Furthermore, the digital controller 24 bidirectionally 
connects to bus interface controller 26 that is attached to bidirectional control bus or user 
level control bus 32. 

Device 30 has a user functionality 38 that for the case of a VCR may store TV 
items that had been received in device 20 and/or output stored items for display by device 20, 
for which functions the bidirectional interconnecting line 42 will cater. The operation of 
device 30 is governed by a central digital controller 34. The device 30 has no counterpart 
subsystem that would correspond to speech recognition controller 22. Even if this counterpart 
were present, the application of the present invention could cause it to suppress its operation, 
although speech out might in principle continue. Various questions, commands, or 
countersignalizations regarding earlier speech recognitions as would be necessary, go to 
device 20 for outputting. Of course, device 30 may have its own signaUzation, such as 
through a text LED. The digital controller 34 in the first place controls the overall operation 
of device 30 in a manner that has been foregone for brevity. Furthermore, it is bidirectionally 
connected to the data bus interface controller 36, in its turn being attached to bidirectional 
control bus 32. Upon first attachment of device 30, controller 34 will transmit necessary 
items for speech recognition through channel 32 and bus controllers 26 and 36, to controller 
24, to subsequently enable speech recognition controller 22 to adequately recognize such 
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menu or other type of speech items that pertain to device 30, rather than to device 20. Of 
course, those speech items that pertain to the master device or an appropriate selection 
thereof may still be recognized as welL 

The speech items sent to device 20 for recognition may pertain to elements of 
a selection menu, and/or may contain speech in the form of a phonetic description. Now, the 
two devices of the illustrated embodiment have been shown interconnected by three lines. 
Line 32 is used for transferring speech recognition information from device 30 to device 20. 
Line 42 is used to transfer data between device 20 and device 30, thereby representing the 
foremost utility of the system. Furthermore, Une 40 interconnects the two controllers 24 and 
34; this line may be virtual in that the physical transport occurs on user level control line 32. 
In principle, such may apply to line 42 as well. The interconnection facility 32 may be bus, 
star, or any applicable configuration, and the inventor presently prefers the HAVi 
interconnection protocol or context that is presently being proposed for all types of audio 
video interconnections. 

The recognition protocol will signal a recognized or otherwise mapped speech 
item pertaining to device 30 to that device, for thereby governing its operation as appropriate. 
If applicable, the state of the recognition process may dynamically influence the spectrum of 
the recognizable speech items, such as for certain of the slave devices then having only the 
name thereof recognizable. 

Figure 2 illustrates an operational flow chart of the loading and operating 
phases of the system illustrated in Figure L In block 60, the system is started, such as by 
power up, followed by in the master device ascertaining availability and claiming of the 
necessary hardware and software resources. In block 62, the system is configured in that all 
connected devices are called by the master. If insufficient resources are present, such as in 
that the VCR has been uncoupled since power off, this will be reported to the user; for 
simplicity, this feedback has not been shown in the Figure. In block 64, it is checked whether 
any new device is present that had not been reported earlier. If YES, in block 66 the 
necessary speech information is loaded from the new slave device into the master device. 
Thereupon, the configuring is resumed, until all new devices will have been registered. By 
itself, unregistering would be feasible as well. Alternatively, the registering could be a 
continally active background process that intermittently would poll all slave devices. 
Eventually, the exit NO from block 64 is asserted, whereupon the system proceeds to block 
68. Therein, the principal program is executed. In block 70, the controller checks for a 
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teraunation of the operation. As long as NO, the system cycles though block 68. If YES, the 
system goes to block 72, wherein the operation will be terminated. 

Modifications will be apparent to persons skilled in the art such that they 
would remain inside the scope of the appended Claims. By way of example, a newly attached 
slave device could take the initiative for the loading of the speech information as in block 66, 
such as according to a plug-and-play organization. The speech recognition shown here in 
device 20 may alternatively be effected in a remote device such as in a portable telephone 
that connects to one or more slave devices 30. In that case, the remote interconnection with 
the other consumer devices may even be effected by Internet. 



